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ABSTRACT 



Certain aptitude and personality tests were given to the 1964 
Management Curriculum military officer students of the U. S. Naval 
Postgraduate School and the scores were correlated with the academic 
grades received during the first three terms. The results obtained 
confirm that the Graduate Record Examination is an excellent predictor 
of academic performance and indicate that neither the Structured 
Objective Rorschach Test or Allport-Vernon-Lindzey Study of Values are 
useful predictors of academic performance in the Management Curriculum. 
It is recommended that the Graduate Record Examination be administered 
to candidates for the Management Curriculum and that Selection Boards 
be advised of the results to assist in student selection for future 
classes. 
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CHAPTER I 



STATEMENT OF THE PROBLEM 

During the preceding three years, studies have been conducted 
dealing with coefficients of correlation derived by comparing certain 
aptitude test scores with academic performance of the students in the 
Management Curriculum at the U. S. Naval Postgraduate School, Monterey, 
California. This paper may be considered as the fourth in the series 
of these correlation studies. 

I. THE PROBLEM 

This research study was undertaken to assess the characteristics of 
the 1964 Management Curriculum class by means of certain aptitude and 
personality tests and to determine if these tests offer a means of im- 
proving the selection of candidates for the Management Curriculum. 

II. DEFINITION OF KEY TERMS 

Aptitude Tests are tests which are designed to predict ability to learn 
in a specific area. 

Personality Tests are tests which attempt to assess an individuals basic 
interests or personality characteristics. 

Quality Point Rating ( QPR ) refers to a student’s weighted grade score 
computed from standards established by the Naval Postgraduate School 



Staff as follows: 






Performance 


Grade 


Quality Point Number 


Excellent 


A 


3.0 


Good 


B 


2.0 


Fair 


C 


1.0 



1 



Barely Passing 



D 



Q s 0 

Failure X -1.0 

Multiplying the term hour value of a course by the quality point 
number received provides the total quality points for that course, Add- 
ing the quality points for all courses and dividing by the total number 
of credit hours results in a figure defined as the quality point rating. 
For example, if a student received four hours of A and four hours of B „ 
his quality point rating would be 2,50 (4x3 + 4x2)-§-8 hours 

Master 1 s Level Academic Performance . To be eligible for a degree of 
Master of Science in Management, a student must attain a minimum average 
QPR of 2.00 in postgraduate level courses. 

Graduate Record Examination ( GRE ) is a nationally accepted paper and 
pencil aptitude test designed to predict academic potential at the 
graduate level. 

Structured Objective Rorschach Test ( SORT ) is a forced response paper 
and pencil projective ink blot personality test which is designed to 
appraise vocationally significant temperament traits. 

AVL - Study of Values is a paper and pencil personality test which is 
designed to measure the relative prominence of six basic interests. 

Local Questionnaire is a questionnaire which was formulated by the 
authors of this paper for the purpose of ascertaining the general 
interest of Management students in the curriculum both before and after 
commencing the course. 

Correlation Coefficient is a measure of the degree of relationship be- 
tween two or more variables, or, in other words, the degree to which 
variables or measures vary together. Mathematically, the value may 



2 



range from a perfect positive correlation (+1.0) through no relation- 
ship (0.0) to a perfect negative correlation (-1.0). When correlating 
variables, the coefficients indicate roughly the following strengths of 
relationships between the variables: 



Less than .20 Slight, almost negligible relationship 

.20 - .40 Low correlation, definite but slight relationship 

.40 - .70 Moderate correlation, substantial relationship 

.70 - .90 High correlation, marked relationship 

.90 - 1.00 Very high correlation, very dependeable relationship 



Those who employ tests in guidance and selection consider that a 

correlation coefficient should be at least .45 for material usefulness 

1 

and that best results are obtained when the coefficient is above .60 . 
Reliability Coefficient is a measure of the repeatability of the test 
results. It is obtained by correlating the test with itself to determine 
the degree of similarity of results if the test is retaken in the same or 
alternate form or by splitting the test into halves. A reliability co- 
efficient of at least .80 is desirable for a test to be considered re- 
liable^. 

Confidence Level as used in this paper is 95 percent and is the probability 
that the true correlation coefficient for the entire population lies with- 
in a given range. 

^J. P. Guilford, Fundamental Statistics in Psychology and Education 
(first edition New York and London: McGraw-Hill Book Company, Inc., 1942), 

p. 219) 

2 Ibid. 
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III. ASSUMPTIONS 



The acceptance of standard statistical methods of computing correla- 
tion coefficients, confidence limits and lines of regression is assumed. 

IV. LIMITATIONS 

This study is limited to the analysis of course grades through the 
first three terms of the four term 1963-1964 Management Curriculum be- 
cause of time limitations. Historically the grades during the third and 
fourth terms have been higher than those of the first and second terms 
and this trend is in evidence at the end of the third term. Therefore, 
it is expected that the final QPR's will be somewhat higher than those 
reported in this paper. 

The practice of alphabetical grade assignment provides a comparative 
ly coarse indication of student performance. For instance, there is far 
less difference between A- and B+ levels of performance than between A+ 
and B- levels of performance, yet the grade assignment would be A and B 
in both instances. This results in some distortion in the QPRs generated 

V. RESEARCH SIGNIFICANCE 

This study differs from the three which were done previously in that 
it attempts to determine if there exist any significant correlations be- 
tween academic performance and interests or personality ch&racterist ics 
of Management Curriculum students. 
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CHAPTER II 



DESCRIPTION OF INSTRUMENTS 
I. GRADUATE RECORD EXAMINATION-GRE (APTITUDE) 

This test is prepared by the Educational Testing Service of Prince- 
ton, New Jersey, and is widely used throughout the United States to deter- 
mine student aptitude for postgraduate study. It yields two scores: verbal 
ability and quantitative ability. Included in the test are verbal reason- 
ing questions, reading comprehension questions, and various kinds of mathe- 
matical problems involving arithmetic reasoning, algebra, and the interpre- 
tation of graphs, diagrams, and descriptive data. 

The table of norms for the GRE (Aptitude) indicates that for 3,035 
college seniors the Verbal Ability Test produced a mean score of 492 with 
a standard deviation of 98. The Quantitative Ability Test had a mean score 
of 480 and a standard deviation of 94. Established reliabilities for the 
test are as follows:* 

Test 

Verbal 

Quantitative 

*Score Interpretation Handbook 

The GRE is a secure test which is lent to using agencies to be admin- 
istered under controlled conditions. The GRE (Aptitude) requires a total 
working time of 2-1/2 hours. All Management Curriculum students completed 
the aptitude section of the GRE the week prior to the beginning of the 
School year. 



Reliability 

Coefficient 

.90 

.84 
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IT. STRUCTURED- OBJECTIVE RORSCHACH TEST-SORT 



This is a personality test prepared by the California Test Bureau of 
Los Angeles, California, The SORT is similar to the traditional unstructur- 
ed Rorschach projective ink blot test in that: (1) the ten original stimul- 
us blots are used; and (2) the same scoring system of area, determinants, and 
content is employed. However it differs from the traditional Rorschach in 
that: (1) it is not intended for clinical use but rather as an instrument 
for assessing temperament tendencies or personality traits; (2) the stimulus 
responses are provided to the examinee, making the element of suggestion of 
response an integral part of the test; (3) the total number of responses is 
fixed, permitting stencil scoring of the answer sheets; and (4) no inquiry 
of examinee responses is conducted, obviating the need for a trained psychol- 
ogist . 

The scores are obtained from items grouped together in triads to which 
the examinee responds by choosing the one item of the triad which he per- 
ceives to be representative of the ink blot or some part of the blot. The 
scores obtained from the SORT are grouped according to standard Rorschach 
scoring techniques. The test produces 15 basic scores which are grouped 
into four classes as follows: 

RORSCHACH VARIABLE SCORES 

Responses to Blot Area 

(1) whole blot (W) 

(2) major blot details (D) 

(3) minor blot details (Dd) 

(4) white space <,S) 
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Determinant Factors 



(5) responses closely resembling the form of the stimulus (F) 

(6) responses poorly resembling the form of the stimulus (F-) 

(7) responses involving human movement or posture-tension (M) 

(8) responses involving animal movement or posture-t ension (FK) 

(9) responses involving color and closely resembling the form of the 
stimulus (FC) 

(10) responses involving color and poorly resembling the form of the 
stimulus (CF) 

(11) responses involving textural density of gray or shading (Fch) 

Content Factors 

(12) responses involving whole animals or parts of animals (A) 

(13) responses involving total human figure or parts of humans (H) 
Statistically Derived Scores 

(14) modal responses (P) 

(15) rare responses (0) 

From these 15 scores, an assessment of 24 different personality traits 

is derived. A description of the personality traits, which the test pur- 

3 

ports to measure, was taken from the test manual and is included as Ap- 
pendix C. 

The population on which the SORT norms are based numbers 8,061 adults. 
Two test-retest studies of the reliability of the 15 variable scores are 
reported in the test manual. The subjects for these studies were 79 col- 
lege students and 94 industrial supervisors; the time between administrations 

3 

Joics B. Stone, S-0 Rorschach Test Manual (preliminary edition; Los 
Angeles: California Test Bureau, 1958, pp. 15-16.) 
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was one week. The resulting reliability coefficients were as follows: 



Subjects 



Reliability 
Coefficient Range 
for 15 Scores 



Median 



College Students (N = 79) .62 to .90 



.75 



Industrial Supervisors (N=94) .61 to .84 



.76 



The test manual reports three concurrent validity studies of the SORT 
involving more than 4,000 individuals. The 15 scores were variously found 
to yield meaningful correlations with industrial employee ratings and with 
grade point averages of college freshmen. In one study involving 70 sub- 
jects, the supervisory ratings and SORT scores were found to be within nine 
points of agreement on a 100 point scale, 71 percent of the time. 

The SORT takes approximately 30 minutes to administer. It was given 
to All Management Curriculum students during a regularly scheduled class 
period during the third term. 



This is a personality or interest test distributed by the Houghlin 
Mifflin Company of Boston, Massachusetts. It is designed to measure the 
relative prominence of six basic interests or motives in personality: 
theoretical, economic, aesthetic, social, political, and religious. The 

4 

classification is based directly upon Edward Spanger tf s Types of Men . A 
more complete description of those attributes which the test purports to 
measure is included in Appendix D. 

The test consists of a number of questions based on a variety of 
familiar situations to which alternative answers are provided. The examinee 

4 

E. Spanger, Types of Men , translated by Paul J. W. Pigors in Lebens- 
formen (New York: Stechert-Hafuer, Inc. s date unknown). 



III. AVL- STUDY OF VALUES 
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I 

! 



records his preferences numerically and the results are added to deter* 
mine his relative interest in the six values. 

One split-half reliability test of sample size 100 and two test-re- 
test reliability tests of sample sizes 34 and 53 are reported in the test 



manual with 


the following results:^ 






Test 






Reliability Coefficient 


Mean 








Range for Six Values 




Split-Halves 


(N = 100) 




.84 to .95 


.90 


Test-Retest 


(1 Mo. interval, 


N = 34) 


.77 to .91 


.89 


Test-Retest 


(2 Mo. interval, 


N = 53) 


.84 to .93 


.88 



The test is essentially self-administering and requires about 20 
minutes to complete. Of the five Management Curriculum sections, three 
completed the test during regularly scheduled class periods and the other 
two sections completed it outside of class, 

IV. LOCAL QUESTIONNAIRE 

This is an eight question multiple choice questionnaire which was de- 
signed by the authors of this paper. A copy of the questions along with a 
bar graph of the results is included in Appendix E. An attempt was made to 
structure the questionnaire so that the answers progressed from the higher 
to the lower motivational level; i.e., the first answer is intended to in- 
dicate the highest student motivation and the last answer the lowest student 
motivation for the Management Curriculum. 



^Gordon W. Allport, Phillip E. Vernon, and Gardner Lindzey, Study of 
Values-Manual , Boston: Houghlin Mifflin Company , (1960) , pp. 4-5. 
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CHAPTER III 



METHODS, TECHNIQUES, AND PROCEDURES 
I. GENERAL 

All 99 officer students of the 1964 Management Curriculum constituted 
the respondents for this study. The pertinent characteristics of the 
members of the class are listed in Table I. There were no significant 
differences between the constitution of the 1962, 1963, and 1964 Manage- 
ment classes. 



TABLE I 

MANAGEMENT CURRICULUM STUDENT RANKS, DESIGNATORS, AND MILITARY COMPONENTS 



Rank/ Designator 


CDR/LC0L 


LCDR 


LT 


TOTAL 


Line (1100) 


13 


12 


10 


35 


Line (1310-1350) 
Aviation 


11 


11 


3 


25 


Line (1510-1515) 
(WEDO) 




2 




2 


Line (1610) 
Communicat ions 


1 






1 


Supply (3100) 


5 


14 


3 


22 


CEC (5100) 


1 


1 


3 


5 


MSC (2300) 






4 


4 


USMC 


1 






1 


USCG 




3 


1 


4 




32 


43 


24 


99 


The basic data 


used in the study 


includes the 


scores obtained from 


academic grades and 


the aptitude and 


personality tests 


previously described 
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The academic grades, QPRs, and GRE and personality test scores are 
listed in Appendixes A and B opposite student identification numbers 
which were assigned to preserve anonymity. The data listed in Appendixes 
A and B was punched onto IBM cards for each student y and by means of a 
computer program this data was used to generate correlation coefficients. 
Prediction data was calculated by means of regression analysis and plotting 
of scatter diagrams. 

II. CORRELATION ANALYSIS 

The data listed in Appendixes A and B was punched onto IBM cards, 
one for each student, as follows: 

QPR Total Score 
GRE Average Score 
GRE Verbal Score 
GRE Quantitative Score 

15 Rorschach Variable Scores as listed in Chapter II. * 

6 Study of Values Scores as listed in Appendix D, 

* All Rorschach scores used were raw data scores. 

Statistical comparison of this data was achieved through the Product- 
Moment Method of linear correlation^ as follows: 



Where : 



<r x (Ty 

p = 1 ( xr ) & x )$( y ) 

A/ A/* 

CT = Standard Deviation 

X = Test Score 



Correlation between X and Y' 



= Product Moment 



Frederick Cecil Mills, Statistical Methods Applied to Economics and 
Business (New York: H. Holt and Company, 1938), p. 368. 
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Y = QPR Score 

A/ = 99 (Sample Size) 

Arithmetic relationships were programmed for the 1604 Control Data 
Corporation computer and the desired correlation coef f icients* means* 
variances, and standard deviations thus obtained* 

III. CONFIDENCE LIMITS 

Confidence limits for the coefficient of correlation of the GRE (A) 
to QPR were computed from the formula: 



Lines of regression and associated standard errors were computed for 
the purpose of prediction of academic performance based on GRE scores* 

The lines of regression and associated standard errors were computed from 
the following formulas: 




2 



Where : 



= Correlation coefficient 
A/ = Sample size (99) 



(j^ = Standard error of 

IV. REGRESSION ANALYSIS 



Line of 
Regression 



y'= - r-^x + r 

<*x 0* 



Standard Error 
about Line 
Of Regression 




Where : 



Y = Predicted QPR based on test score X 

= Correlation coefficient GRE (A) to QPR (.6253) 



(J^ = Standard deviation of QPRs 



(*5464) 
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I I 



OJ = Standard deviation of GRE (A) s 
= Mean GRE (A) 

= Mean QPR (third term) 



( 73 . 306 ) 

( 568 . 990 ) 

( 1 . 950 ) 
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CHAPTER IV 



RESULTS OF THE STUDY 
I. GENERAL 

As stated initially, this study had two primary purposes. The first 
was simply to assess the nature of the student population in the Manage- 
ment Curriculum by administering the various personality and aptitude 
tests described previously. The second (and more practical) objective 
was to determine whether or not any of the test results could serve as 
useful predictors of academic success in the Management Curriculum. The 
results presented in this chapter are organized along the lines of these 
objectives. First, test results for each test are discussed independently 
from results on other tests. In the second portion of the chapter, corre- 
lations between test results and student performance is discussed. A 
summary of means and standard deviations for all variables considered is 
provided at the end of the chapter in Table X. 

II. TEST AND QUESTIONNAIRE RESULTS 
GRADUATE RECORD EXAMINATION - (GRE) 

Table II provides a comparison of mean scores achieved on the two 
sections of the GRE (verbal section and quantitative section) by Manage- 
ment students from 1962 through 1964. Information regarding national 
norms is also included for purposes of comparison. 

The data in Table II indicates that the mean GRE scores of the last 
three Management classes have been approximately equal. In addition, it 
indicates that Management students score significantly above national 
norms for college seniors on both the verbal and quantitative portions of 
the GRE. 
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TABLE II 



Mean Scores on GRE 



Sample 


National Norm** 


1962 


1963 


1964 


Sample Size 


Large 


94 


94 


§9 


Test 

GRE (Average)* 


49.4 


56.2 


55.6 


56.9 


GRE (Verbal) 


48.7 


52.6 


51.7 


54.5 


GRE (Quantitative) 


50.0 


59.7 


59.5 


59.3 


* 1/2 (GRE (V) & GRE (Q)) 
**Score Interpretation Leaflet 


for Students, Educ 


ational 


Testing Service, 



Princeton, New Jersey. 

STRUCTURED OBJECTIVE RORSCHACH TEST - (SORT) 

Results of the SORT are given in Tables III and IV. 

Table III is a distribution of how the naval officers in the sample 
scored on each of the 24 personality traits measured by the SORT. This 
table permits comparison of the sample with the normative population of 
the SORT which consisted of over 8000 adults drawn from diverse occupa- 
tions. ^ 

The classifications of High, Above Average, Average, etc., were defined 
such that the following percentages of the normative population fell into 
each group: 



High 7% 
Above Average 23 % 
Average 407, 
Below Average 23% 
Low 7% 



Since the naval officer sample size was 99, the number of officers 
scoring in each category (High, Low, etc.) approximates the percentage 

^Joics B. Stone, op.cit., pp. 4-10. 
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in that category. This percentage can then be compared with the normal 
population percentages listed above. For example^ the trait entitled 
Theoretical shows that nine of the 99 officers scored high, 31 above 
average* etc. 

TABLE III 

Distribution of Scores on 24 SORT Personality Traits 

n = 99 





High 


Above 

Average 


Average 


Below 

Average 


Low 


Normal Percent 


77. 


237. 


407. 


237. 


77. 


TRAITS* 


Theoretical 


9 


31 


39 


19 


1 


Practical 


1 


14 


62 


19 


3 


Pedantic 


2 


19 


40 


34 


4 


Induction 


13 


30 


36 


19 


1 


Deduction 


3 


20 


61 


12 


3 


Rigidity 


3 


43 


42 


10 


1 


Structuring 


24 


34 


31 


6 


4 


Concentration 


11 


30 


52 


6 


0 


Range 


2 


25 


54 


18 


0 


Human Relationships 


4 


28 


38 


27 


2 


Popular 


4 


18 


49 


22 


6 


Original 


1 


4 


21 


53 


20 


Persistence 


3 


43 


42 


10 


1 


Aggressiveness 


16 


40 


34 


8 


1 


Social Responsibility 


3 


23 


59 


12 


2 


Cooperation 


1 


10 


61 


26 


1 


Tact 


0 


11 


67 


21 


0 


Confidence 


5 


20 


46 


23 


5 


Cons 1st ency- Behavior 


17 


44 


31 


7 


0 


Anxiety 


4 


18 


47 


24 


6 


Moodiness 


0 


12 


54 


26 


1 


Impulsiveness 


0 


6 


54 


27 


12 


Flexibility 


3 


39 


54 


3 


0 


Conformity 


13 


40 


34 


10 


2 



*A more detailed description of each personality trait measured by the 



SORT is contained in Appendix C. 
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Analysis of the figures in Table III reveals that the naval officers 
in the sample scored high in Induction, Structuring* Concentration* Aggres- 
siveness, Consistency of Behavior and Conformity,, Low scores were in evi- 
dence for Impulsiveness, Moodiness and Original Response. 

Table IV lists each scoring variable in the SORT and shows the mean 
score obtained by the naval officers in the sample* and mean scores of 
a large diverse group of adults, and of several selected occupational 
groups. The occupational groups selected are Industrial Supervisors* 
Industrial Workers, and Salesmen, 

TABLE IV 

Mean Scores on 15 SORT Scoring Variables 
Composite* Naval Industrial* Industrial* 



Variable Population Officers Supervisors Workers Salesmen* 



Sample Size 


n = 5024 


n = 99 


n = 539 


n = 1412 


n «* 140 


w 


31.85 


36.62 


36.00 


30.41 


32.55 


D 


53.66 


54.53 


54.14 


52.73 


54.20 


Dd 


12.80 


11.68 


9.64 


13.62 


12.35 


S 


12.41 


13.32 


12.41 


12.17 


11.00 


F 


27.26 


29.42 


30.32 


27.38 


26.00 


F- 


13.32 


11.40 


10.64 


14.65 


12.25 


M 


8.61 


9.55 


9.09 


8.54 


7.83 


FM 


10.54 


11.17 


11.26 


10.59 


9.88 


FC 


12.72 


13.51 


12.55 


11.41 


12.75 


CF 


7.95 


68.69 


7.14 


8.49 


8.75 


Fch 


16.54 


17.81 


15.00 


16.41 


18.68 


A 


33.15 


32.81 


31.25 


34.76 


27.98 


H 


21.92 


21.14 


24.60 


21.92 


19.98 


P 


57.15 


57.15 


57.91 


57.84 


44.55 


0 


5.03 


5.92 


4.37 


5.12 


4.43 


*Data for all 


columns except 


naval 


officers obtained 


from SORT 


Test Manuals 



A comparison of the scores in Table IV indicates that the average 
response of the 99 naval officers corresponds quite closely with the average 
response of industrial supervisors. For example, both naval officers and 
industrial supervisors are significantly above the composite average in 
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whole blot (W) responses, Form (F), and Form Movement (FM) responses. 

On the other hand, both groups are below average in categories for Small 
Detail (Dd), Poor Form (F-) and Poor Form-Color (CF) . Similar compari- 
sons with the other occupational groups show that naval officer responses 
differ markedly from those of industrial workers and salesmen. 

The comparison of the naval officer sample with other occupational 
groups is not in itself particularly useful. This comparison does give 
considerable insight into the operation of the SORT, however, and provides 
a better basis for interpreting scores. Common sense would probably lead 
one to believe that in their jobs, naval officers are more akin to indus- 
trial supervisors than to either industrial workers or salesmen. Test 
results which coincide with this assessment indicate that the SORT is 
capable of separating people into groups with meaningful characteristics 
from a practical viewpoint. This comparison also points up the possibility 
of using the SORT as a vocational guidance and/or selection tool. 

The comparison with the industrial supervisor group tends to temper 
the results of Table III regarding naval officers. When compared with 
supervisors, the high naval officer scores for Aggressiveness, Structured 
Thought, Conformity, etc., do not seem particularly extreme. Apparently 
there is some tendency for college graduates to exhibit these character- 
istics, and a strong tendency for people in supervisory positions to ex- 
hibit them. 

ALLPORT- VERNON-LINDZEY STUDY OF VALUES (AVL) 

Results of the AVL - Study of Values are given in Tables V and VI. 
Table V is similar to Table III for the SORT wherein each Interest area 
is listed and naval officer responses classified into categories of High, 
Low, etc. Normal population percentages which are listed are different 
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from those in Table III however. 



TABLE V 

Distribution of Naval Officer Response to AVL 
Study of Values Interest Areas 
n = 99 







Above 


Below 








High. .... 


Average 


Average Average 


Low 




Normal Percentage 


97. 


167. 


507. 167. 


97. 




INTEREST AREAS 












Theoretical 


2 


11 


60 20 


6 




Economic 


14 


25 


46 10 


4 




Aesthetic 


7 


16 


44 20 


/ 




Social 


5 


5 


45 24 


20 




Political 


19 


31 


34 11 


4 




Religious 


6 


16 


53 14 


10 




Comparative mean scores 


for the 


naval officer sample s 


college males 


and a group of Air 


Force officers are 


listed in Table VI. 










TABLE 


VI 






Comparative Mean 


Scores on AVL Study of Values 








Naval Officers 


College Males* Air Force Officers* 


Sample Size 


r. = 99 


n = 5,894 




n “ 61 


INTEREST AREAS 












Theoretical 


42.19 




43.09 




42.72 


Economic 


45.90 




42.05 




43.02 


Aesthetic 


34.52 




36.72 




35.12 


Social 


33.62 




37.05 




35.54 


Political 


46.52 




43.22 




46.34 


Religious 


37.08 




37.88 




37.26 



*Data obtained from Allport-Vernon-Lindzey Study of Values Manual* 
Houghlin Mifflin Company, Boston, 



The results in Tables V and VI do not reveal any marked differences 
between naval officers in the sample and the normative population* It 
should be noted that the AVL was standardized on a group of college 
students, however, so more homogeneity might be anticipated than in the 
case of the SORT which was standardized on a more diverse population* 
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There does appear to be some tendency for naval officers to score 
high on the Political and Economic scales and low on the Socit. scale* 

(A description of interest area titles is contained in Appendix B«) It 
is also interesting to note the close correspondence between mean scores 
for naval officers and the sample of 61 Air Force officers* 



LOCAL QUESTIONNAIRE 

At the end of the first and second terms of the Management course 
the student QPRs were somewhat lower than those of previous years* In 
seeking the reason for the lower performance the question of student motiva- 
tion arose. Consequently, the local questionnaire was promulgated during 
the third term to obtain a subjective indication of the interest of the 
Management students in the curriculum* 

The results obtained from the local questionnaires of 98 students are 
depicted on bar graphs in Appendix E. The bar graphs illustrate the fol- 



lowing: 

Graph E- 1 88 Students requested assignment to the Management Curriculum 

as first or lesser choice* 



Graph E-2 54 Students found the course at least fairly close to what 

they expected. 

Graph E- 3 57 Students were highly elated to receive orders to the 

Management Curriculum and only one was disappointed. 

Graph E-4 65 Students probably or definitely would have chosen to re- 

main in the Management Curriculum if they had been given 
the option of reassignment at the end of the first term* 



Graph E-5 At receipt of orders to the Management Curriculum 80 students 
considered that completion would enhance their promotion 
potential. 

Graph E-6 At the time of completion of the local questionnaire only 51 
students considered that assignment to the Management Cur- 
riculum had enhanced their promotion potential* 
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Graph E-7 At receipt of orders to the Management Curriculum 82 

students considered that completion would greatly enhance 
their "on the job" performance in the future „ 

Graph E-8 At completion of the local questionnaire only 65 students 
considered that assignment to the Management Curriculum 
would greatly benefit their "on the job" performance in 

the future. 

From these results it appears that the motivation of the current 
students is generally good. From the shift in distributions between graphs 
E-5 and E-6 and between E-7 and E-8 it may be inferred that there was a 
reduction in motivation between order receipt and local questionnaire comple- 
tion. 



III. CORRELATION ANALYSIS 

Table VII lists correlation coefficients for all test score variables 
against the third term QPR. (A complete interccrrelat ion table of all 
variables included in the study is included at the end of the chapter in 
Table XI.) 

TABLE VII 

Coefficients of Linear Correlation Between 24 
Test Scores and Third Term QPRs 



Test Score 


Coeff. of 
Correlation 


Test Score 


Coeff. of 
Correlation 


GRE(A) 


.625 


SORT OF 


.060 


GRE(V) 


.453 


" Fch 


-.095 


GRE(Q) 


.552 


" A 


-.161 


SORT W 


-.215 


" H 


.040 


" D 


. 196 


" P 


-.039 


" Dd 


.060 


" 0 


.056 


" S 


.104 


AVL T 


.134 


" F 


. 104 


" E 


-.140 


" F- 


-.097 


" A 


.156 


" M 


.101 


" s 


-.061 


" FM 


-.074 


" P 


-.214 


" FC 


-.052 


" R 


.073 



As mentioned previously^ a correlation coefficient of approximately 
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.45 or higher is considered necessary if test scores are to be useful 

g 

for predictive work. The Graduate Record Exams are the only test scores 
with correlation coefficients over .45. It does not appear that scores 
on SORT or AVL factors are by themselves useful for predicting academic 
success in the Management Curriculum. 

CONFIDENCE LIMITS 

The 95 % confidence limits on correlation coefficients of the GRE 
scores against third term QPR c s are as follows: 

TABLE VIII 

Confidence Limits GRE/QPR Correlation Coefficients 



Test 




Correlation 

Coefficient 


95 % Confidence 
Lirr.it 


Range of 
Limits 


GRE 


(Verbal) 


.4529 


+ .1574 


. 6103--- . 3955 


GRE 


(Quantitative) 


.5524 


+ .1376 


.6900- --.4148 


GRE 


(Average) 


.6253 


+ .1206 


. 7459-“- . 5047 



In view of the confidence limits in Table VIII, there can be little 
doubt but that the GRE score is an excellent predictor of academic success 
in the Management Curriculum. 

REGRESSION ANALYSIS 

Having established the GRE as a good predictor of academic success^ 
a line of regression with associated standard error was computed in 
accordance with the procedure described in Chapter III. This resui ed in 
the following line of regression and standard error about the line: 

Y = 0.00466X - 0.702 
and SY » 0.4264 

Figure 3 page 26 depicts the line of regression of the GRE(A) against 
the QPR. 

g 

J. P. Guilford, loc cit , 
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COMPARISON WITH PRIOR YEARS 



In their study of the 1963 Management class , Kauder and Ebert com* 

9 

puted lines of regression for the 1962 and 1963 classes. These lines 
are reproduced herein (with modification of scale) as Figures 1 and 2 U 
(Page 25 ), Kauder and Ebert noted the very marked shift that took 

place in the line of regression between 1962 and 1963, This shift has 
continued and become more pronounced in 1964. Figure 4 (Page 26 ) provides 
a comparison of these lines for the past three years. 

Kauder and Ebert concluded that the 62/63 shift occurred because the 
faculty had raised its grading standards in 1963. There can be little 
doubt but that their conclusion was correct. It Is also apparent at this 
time that grading standards were again raised in 1964. As was pointed out 
earlier, the GRE scores of the last three classes have been approximately 
equal and yet the average third term QPR has declined steadily each year. 
Comparative mean third term QPRs are as follows: 

Year Mean QPR 

1962 * 2.33 

1963 * 2.17 

1964 - 1.95 

It appears that the predictive ability of the GRE is improving as the 
grading standards become more stringent. This is illustrated by the fact 
that the correlation coefficient between the QPR and GRE has increased in 

9 

Robert Kauder and Scott W. Ebert, "An Investigation of the Validity of 
Certain Aptitude Tests in Predicting Academic Performance in the Navy Manage- 
ment Curriculum at the United States Naval Postgraduate School", (Unpublish- 
ed Research paper, U. S. Naval Postgraduate School, Monterey, 1963) pp. 26- 
28. 
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each of the last three years as indicated below: 



Year Correlation Coefficient 

1962 ,4839 

1963 * 5826 

1964 • 6250 

The constantly shifting line of regression makes it difficult to 
establish a cut-off score on the GRE that could be utilized for selection 
of applicants for the Management Curriculum. With such a shifting line it 
is impossible to take a strict statistical approach and predict with confi- 
dence that if a cut-off of some certain score were established, a certain 
percentage of incoming students would attain a QPR of 2,00 or better. 
Despite this difficulty, the authors believe that a lew cut-off on the GRE 
(probably around 500) could be used to advantage. For example^ had such a 
cut-off been used in 1963 and 1964, the following would have occurred: 

TABLE IX 



Results of Using a Cut-off Score of 500 on the GRE(A) 









1963 


1964 


Students eliminated by 


500 cut-off on 


GRE (A) 


25 


19* 


Number eliminated with 


QPR above 2.00 


(3rd term) 


9 


3 


Number eliminated with QPR below 2.00 


(3rd term) 


16 


16* 


% of total class below 


2.00 before cut 




327. 


527. 


% of total class below 


2.00 after cut 




077. 


417. 



^Includes 2 students who dropped out of school prior to the 3rd term. 

As may be noted from Table IX, a cut-off of 500 on the GRE (A) would 
have resulted in dramatic improvement in 1963 academic achievement but also 
would have eliminated 9 students with QPRs over 2,00, In 1964 only 3 
students over 2.00 would have been eliminated, but having 417, of the class 
still remaining below 2.00 is an unsatisfactory condition. Nevertheless, 
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LINE OP REGRESSION 




300 400 600 (X) 600 700 



Average of Graduate Record Exam Scores GRE (A) 



LINE OP REGRESSION 




Average of Graduate Record Exam Scores GRE (A) 
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LINE OF REGRESSION 




300 400 500 (X) 600 700 

Average of Graduate Record Examination Scores GRE (a) 




Average of Graduate Reoord Examination Scores GRE (A) 
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replacing 16 officers with QPRs below 2,00 by 16 other selectees with 
much higher probability of achieving a satisfactory QPK would still seem 

to be a highly desirable outcome. 

TABLE X 

Summary of Means and Standard Deviations 
of All Variables Included in the Study 

n = 99 



Variable 


Mean 


Standard Deviation 


QPR (3rd term) 


1.95 


0.55 


GRE (Average) 


56o 90 


7.33 


GRE (Verbal ) 


54.53 


8. 75 


GRE (Quantitative) 


59.3 3 


9.45 


SORT W 


33.53 


5.51 


" D 


54.53 


4.46 


" Dd 


11.63 


3.10 


" S 


13.32 


2.55 


" F 


29.42 


5.50 


" F- 


11.40 


3.02 


" M 


9.55 


3.13 


" FM 


11.17 


2.00 


" FC 


13.51 


2.52 


" CF 


6.87 


2.19 


" FCh 


17.81 


4.21 


" A 


32.81 


4.39 


" H 


21.14 


4.34 


" P 


57.15 


6.46 


" 0 


5.92 


2.81 


AVL T 


42.19 


5.91 


" E 


45.90 


7.53 


" A 


34.52 


8.07 


" S 


33.66 


7.55 


" P 


46.52 


7.54 


" R 


37.08 


8.84 
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GRS(A) GRS(V) GRS(Q) 



TABLE XI 



Intercorrelation Coefficients for All Variables Included in the Study 
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CHAPTER V 



CONCLUSIONS AND RECOMMENDATIONS 
I. CONCLUSIONS 

A. The Graduate Record Exam is an excellent predictor of academic 
performance in the Management Curriculum* This conclusion has held for 
three successive classes under various grading standards. 

B. The higher the grading standards* the greater the predictive 
ability of the GRE. 

C. Neither the SORT nor AVL Study of Values are by themselves use- 
ful predictors of academic success in the Management Curriculum. Xhe 
possibility of combining scores on these tests in various combinations 
or with the GRE to obtain higher correlation than with the GRE alone was 
not investigated. 

II. RECOMMENDATIONS 

It is recommended that: 

A. The GRE be administered to the candidates for the Management 
Curriculum. 

B. Selection Boards be informed of candidate S v scores on the GRE and 
be advised that applicants with an average GRE score of less than 500 have 
a low probability of successfully completing the curriculum. 
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ACADEMIC -AND GRADUATE RECORD EXAMINATION SCORES 
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ACADEMIC- AND GRADUATE RECORD EXAMINATION SCORES 




Structured Objective Rorschach Test (SORT) f Study of Values 
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Structured Objective Rorschach Test (SORT) / Study of Values 




Rprschach and Study of Values Scores 
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PERSONALITY TRAITS WHICH THE STRUCTURED OBJECTIVE 
RORSCHACH TEST (SORT) SEEKS TO MEASURE 

General: Scores in Mental Functioning and Temperament factors are expres- 
sions of the degree of the factor relative to scores generally distributed 
in the population. That is, high scores and those above average do not 
imply a degree that is "good," "bad," "healthy/* or "advantageous , " A high 
score simply indicates that the examinee has made more responses than the 
typical individual to a particular variable. The evaluative interpretation 
(high or low) depends upon the nature of the factor and its contribution to 
the individual's life. 

MENTAL FUNCTIONING 

Intellectual level does not necessarily reflect intellectual performance* 
It is desirable to know such features as the type of approach to intellec- 
tual situations used, adaptability to the reasoning processes* flexibility 
of ideas, and ability to organize (structure) mental processes. 

Theoretical (W) : Facility for thinking in broad* general* or abstract 

terms; facility for getting perspective, visualizing the overall picture* 
and seeing relationships between the parts. 

Practical (D) : Tendency for thinking or attacking problems on the basis 

of practical, concrete, or very definite details. 

Pedantic (Dd): Preference for thinking and attacking problems from the 
standpoint of fine, minute details; tendency to be perfect ionistic and to 
focus on precise, sometimes trivial details. 

Induction (W:M): Facility for logical thinking based upon inferences 

from elements; utilization of their accumulative synthesis to lead to con- 
clusions, principles, or generalizations; ability to organize details into 
a meaningful whole. 

Deduction (D:M): Readiness to employ the logical approach in which 

established or speculative theories, principles* or generalizations are 
applied to data or details for the purpose of analyzing their relation- 
ships to one another (and to the principle probably involved). A balance 
between facilities for inductive and deductive thinking* especially ^hen 
both are high, would point toward a mental adaptiveness or "efficiency" 
wherein such intellectual potential as the individual has is the more ef- 
fective because of versatility in logical processes. 

Rigidity (S): Tendency toward the dogmatic or toward fixed ideas. 

Higher scores suggest an unwillingness to change a point of view in spite 
of evidence to the contrary; low scores suggest an uncritical acceptance 
of others' viewpoints. 

Structuring (F) : Facility for mental alertness and precision and exact- 

itude in perception of reality. Occasionally this relates to a somewhat 
rigid and formalistic way of solving problems* but usually indicates an 
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awareness of and conformity to the environment and its demands. 



Concentration (F-:F): Capacity for attending to the task at hand or 

for avoiding distractions from one’s environment or from one v s own extran- 
eous thoughts. 

REDUCTIVES 

Factors that result in lowering intellectual performance below one's 
mental potential are called Reductives and are listed below. 

Low Generalization (Low W) : The Theoretical (W) factor rates so low 
that attention to principles, perspectives, or theoretical implications is 
difficult. 

Perfectionism (High Dd) : The Pedantic (Dd) factor is so extremely high 
that thought is lost in a welter of preoccupation with minutiae. 

Poor Control (High F-): The preponderance of n F-“ in the Concentra- 

tion factor is such that thought is not channeled readily into effective 
processes . 

High Anxiety (High Fch) : The Anxiety (Fch) factor is so high that 

acceptance of one’s own conclusions is difficult; as a result, the ability 
to “think a thing through” is impaired. Excessive worry and feelings of 
insecurity or incapacity may be dominant. 

Compulsivity (High S, F, and D) : A combination of the Structuring (F), 
Rigidity (S) , and Pedantic (Dd) factors is of such magnitude that needless 
repetition, excessive exactness, and unreal conformity result in preventing 
the full mental processes from proceeding to a logical conclusion. 

INTERESTS 

These facets of behavior refer to the range of reactions to perceptual 
experience. Sensitivity to a variety of kinds of percepts implies a broad- 
er range of interests than does a paucity of percept -types . 

Range (H:P::A): Tendency of interest to be either expansive or to be 

narrow and confined. 

Human Relationships (H) : Disposition toward the perception of and 

attention to elements having human connotations. 

RESPONSIVENESS 

Two frames of reference are involved here. The first derives from the 
modality of responses, the second from the frequency of responses. It is 
assumed that responses to items most frequently seen by the majority of 
the normative group are indicative of conformity. Conversely, consistent 
selection of rarely observed items implies a disposition toward uniqueness. 

Popular (P) : Tendency to perceive the same features in the same way 

as others; to see things as other persons do; empathic tendencies. 
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Original (0): Disposition to perceive the unique, the different, and 

the non-conforming, perhaps even the eccentric; emphasis on individualism 
of actionSo 

TEMPERAMENT 

The attributes listed under this heading relate largely to deep inner 
feeling, for which there often are compensations in outwardly observed be- 
havior. Many of the compensations can become occupational advantages* 

Persistence (S) : The determination not to deviate from a set course. 

It may appear as doggedness or stick-to-itiveness. It can range from in- 
ability to stick to or complete a task along to the further extreme of 
stubborness, defiance, or contentiousness. 

Aggressiveness (F:M): The aspiration toward goals by means of well- 

accepted and morally developed procedures; willingness and desire to work; 
sense of a mature self-control with social conformity. 

Social Responsibility (FC:M): Willingness to subserve oneself, even 
though no personal gains are evident; energetic acceptance of one’s obli- 
gations to himself, to his family, and to society. 

Cooperation (CF:FC): Willingness to use a teamwork approach; sensi- 

tivity toward others in combination with appreciation and responsiveness 
in human relationships. Willingness to submerge one’s immediate needs to 
the long-range interests of other persons is implied. 

Tact (FM:FC*M): Control of impulses and biases; maturity expressed In 
the ability to maintain a stable relationship with superiors, peers, and in- 
feriors. There is balance between inner impulses, conscious self-control, 
and demands of the social environment. 

Confidence (FM:M): Ego-strength, self-confidence, morale; inner feel- 

ings of inferiority to strong feelings of self-assurance. It implies 
ability to withstand stresses and strains and to maintain feelings of self- 
worth (prestige) in the face of adversity. 

Consistency of Behavior (F::S:Fch): Predictability of actions; tendency 

for characteristic behavior patterns to be stable and well established. 

Anxiety (Fch) : Generalized apprehensiveness, uneasiness, or Internal 

disquietude; self-concern and preoccupation with personal well-being, feel- 
ings, emotions, and sensations, resulting from a feeling of insecurity* 

A low anxiety score indicates composure; however, excessive composure, or 
almost complete absence of anxiety, may indicate a tendency to smother 
feelings to the point of seeming cold and insensitive. Anxiety may re- 
flect itself in feelings of insecurity, expressions of inadequacy, or con- 
striction of behavior; it may also reflect itself in erratic behavior. 

Moodiness (F- :FM: :F:M) : Sharp fluctuations in mood, ranging from ela- 
tion to depression. The intensity and duration of either phase may vary 
greatly. 
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Activity Potential (M) : Control of emotional energy; energy endowment; 

capacity to follow through on a planned course of action; concentration of 
energies in a given direction, as opposed to dissipation of strength in 
non-productive channels . 

Impulsiveness (F-:F): Tendency to act upon impulse rather than on the 
basis of a considered plan; reflected in spur-of-the-moment decisions. 

Flexibility (M::FC:CF): Adaptability; faculty for accepting and hand- 

ling most life situations in a mature manner; capacity to adjust readily 
from one type of situation to another. 

Conformity (0:P): Tendency to accept and be directed by the socially 
accepted codes, customs, and mores. 
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SIX BASIC INTERESTS OR MOTIVES IN PERSONALITY 
WHICH THE "STUDY OF VALUES" SEEKS TO MEASURE 



1. The Theoretical o The dominant interest of the theoretical man is the 
discovery of truth. In the pursuit of this goal he characteristically 
takes a "cognitive" attitude* one that looks for identities and differences* 
one that divests itself of judgments regarding the beauty or utility of 
objects* and ^eeks only to observe and to reason. Since the interests of 
the theoretical man are empirical, critical, and rational* he is necessarily 
an intellectualist , frequently a scientist or philosopher. His chief aim in 
life is to order and systematize his knowledge. 

2. The Economic . The economic man is characteristically interested in 
what is useful. Based originally upon the satisfaction of bodily needs 
(self-preservation), the interest in utilities develops to embrace the 
practical affairs of the business world -- the production* marketing* and 
consumption of goods, the elaboration of credit, and the accumulation of 
tangible wealth. This type is thoroughly "practical" and conforms well to 
the prevailing stereotype of the average American businessman. 

The economic attitude frequently comes into conflict with other values. 
The economic man wants education to be practical, and regards unapplied 
knowledge as waste. Great feats of engineering and application result from 
the demands economic men make upon science. The value of utility likewise 
conflicts with the aesthetic value, except when art serves commercial ends. 
In his personal life the economic man is likely to confuse luxury with 
beauty. In his relations with people he is more likely to be interested 
in surpassing them in wealth than in dominating them (political attitude) 
or in serving them (social attitude). In some cases the economic man may 
be said to make his religion the worship of Mammon. In other instances* 
however, he may have regard for the traditional God* but Inclines to 
consider Him as the giver of good gifts, of wealth, prosperity , and other 
tangible blessings. 

3. The Aesthetic . The aesthetic man sees his highest value in form and 
harmony. Each single experience is judged from the standpoint of grace* 
symmetry, or fitness. He regards life as a procession of events; each 
single impression is enjoyed for its own sake. He need not be a creative 
artist, nor need he be effete; he is aesthetic if he but finds his chief 
interest in the artistic episodes of life. 

The aesthetic attitude is, in a sense, diametrically opposed to the 
theoretical; the former is concerned with the diversity* and the latter 
with the identities of experience. The aesthetic man either chooses, with 
Keats, to consider truth as equivalent to beauty, or agrees with Mencken* 
that "to make a thing charming is a million times more important than to 
make it true." In the economic sphere the aesthete sees the process of 
manufacturing, advertising, and trade as a wholesale destruction of the 
values most important to him. In social affairs he may be said to be 
interested in persons but not in the welfare of persons, he tends toward 
individualism and self-sufficiency. Aesthetic people often like the 
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beautiful insignia of pomp and power, but oppose political activity when 
it makes for the repression of individuality , In the field of religion they 
are likely to confuse beauty with purer religious experience. 

4. The Social . The highest value for this type is l^ve of people. In 
the "Study of Values” it is the altruistic or philanthropic aspect of love 
that is measured. The social man prizes other persons as ends* and is 
therefore himself kind, sympathetic, and unselfish. He is likely to find 
the theoretical, economic, and aesthetic attitudes cold and inhuman. In 
contrast to the political type, the social man regards love as itself the 
only suitable form of human relationship. Spranger adds that in its pur- 
est form the social interest is selfless and tends to approach very closely 
to the religious attitude. 

5. The Political . The political man is interested primarily in power. His 
activities are not necessarily within the narrow field of politics; but 
whatever his vocation, he betrays himself as a Machtmensch. leaders in any 
field generally have high power value. Since competition and struggle play 
a large part in all life, many philosophers have seen power as the most 
universal and most fundamental of motives. There are, however* certain 
personalities in whom the desire for a direct expression of this motive is 
uppermost, who wish above all else for personal power* influence* and 
renown. 

6. The Religious . The highest value of the religious man may be called 
unity. He is mystical, and seeks to comprehend the cosmos as a whole* to 
relate himself to its embracing totality. Spranger defines the r ligious 
man as on ”whose mental structure is permanently directed to the creation 
of the highest and absolutely satisfying value experience.” Some men of 
this type are ”immanent mystics,” that is, they find their religious experi- 
ence in the affirmation of life and in active participation therein. A Faust 
with his zest and enthusiasm sees something divine in every event. The 
"transcendental mystic,” on the other hand, seeks to unite himself with a 
higher reality by withdrawing from life; he is the aescetic* and* like the 
holy men of India, finds the experience of unity through self-denial and 
meditation. In many individuals the negation and affirmation of life 
alternate to yield the greatest satisfaction. 



58 



LOCAL QUESTIONAIRE BAR GRAPHS 




0. 1# Did you request assignment to Mgmt Postgraduate School? 

(1) Yes, as first choice on data card and in addition I con= 
tacted my detailer to urge assignment to the School® 

(2) Yes, as first choice on data card. 

(5) Yes, as second or lower choice on data cardo 

(4) No 

(5) No, and I made a specific attempt not to be assigned. 




Q. 2. Does the course content of the Mgmt curriculum correspond to 
what you expected at the time you requested assignment? 

(1) Course content is very close to what I expected,, 

(2) Course content is fairly close to what I expected. 

(3) Content is considerably different from what I expected. 

(4) Course content is not at all what I expected® 

(5) I didn't know anything about the course vfhen I requested 
fiss igmnent • 

APPENDIX E 
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LOCAL QUESTIOMAIRE BAR GRAPHS 
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Graph E~3 

Q. 5. Were you pleased to receive orders 
to Management School? 

Highly Elated ////// Disappointed 
1 2 5 4 5 
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Ouestions 
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Ouestions 

Q. 4. If you were given the option at the end of the first term of 
continuing in the Mgmt curriculum or of being reassigned s 

(1) I would definitely choose to remain in school. 

(2) I would probably choose to remain in Mgmt School. 

(3) I would have been indiferent as to the choice. 

(4) I would probably choose to be reassigned. 

(5) I would definitely choose to be reassigned. 
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LOCAL QUESTIONAIRE BAR GRAPHS 
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(2) (5) 

Questions 



(4) 



(5) 



Q. 5. At the time you received orders to Management School^, did you 
feel that completion of the school ■would enhance your promo- 
tion potential or be a detriment? 

Greatly Enhance ////// Be Detrimental 
1 2 3 4 5 




Q. 6. At this time do you feel that assignment to the Mgmt School 

has enhanced your promotion potential or has been detrimental? 

Greatly Enhanced ////// Been Detrimental 
1 2 3 4 5 
APPENDIX E 
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LOCAL QUEST IONAIRE BAR GRAPHS 




Q« 7. At the time you received orders to Mgmt School did you feel 
that completion would benefit your ”on the jcb” performance 
in future duty assignments? 

Ee of Great Eenefit ///// / Be of Very 

12545 Little Value 




Questions 

Q. 8. At this time do you feel that attendence at Management School 
will benefit your ”on the job” performance in future duty 
assignments? 

Be of Great Benefit ////// Be of Very 

12345 Little Value 
APPENDIX E 
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